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REMARKS 

Claims 20 and 22 have been deleted and claims 33 and 34 added by this amendment. 
Claims 16,17 and 24-29 have been withdrawn. Therefore, on entering this amendment, claims 
14, 15, 18, 19, 21, 23, 30-34 are all the claims pending in the application. 

In the Advisory Action, the Examiner notes that the drawings submitted on December 
2003 have been approved by the Examiner. 

The Examiner continues to object to the specification. The Applicant respectfully 
submits that subsections and the order of presenting them are not held to be absolute 
requirements under current US patent laws and practice. However, for a speedier resolution of 
the issue, the Applicants submit a substitute specification. Also attached is a marked-up copy 
indicating changes from the substitute specification as filed on January 21, 2003, which the 
Examiner notes is the Specification presently of record. 

The Applicants respectfully submit that no new matter has been added. 

Claims 14, 17, 23, 30 and 31 have been objected to. The Applicants respectfully amend 
these claims to overcome the objection. 

Claims 14, 18, 20, 21 and 30-32 have been rejected as being anticipated by Ogawa 
(5,694,203). 

Claims 15, 19, 22 and 23 have been rejected as anticipated by Stern (5,216,259). 
The Applicants traverse the rejections and request reconsideration. 
The Applicants thank the Examiner for the detailed technical comparison between the 
cited references and the present invention. In the outstanding Office Action, the Examiner 
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provides some suggestions for amending claims. Specifically the Examiner suggests adding 
limitations, including "illuminating an object sequentially with two illuminating lights, one of 
which has a linearly varying intensity and the other of which has a constant intensity" (or its 
equivalents). In a telephone conversation with the Applicants' representative, the Examiner 
clarified that the above limitations and their equivalents are free of prior art. 

The Applicants amend claims 14 and 15 to include the above limitation. Accordingly, 
claims 20 and 22 have been deleted. Claim 30 has been amended as appropriate to include 
similar limitations. New claims 33 and 34 have been added to include the equivalent limitation 
that one of the illuminating lights has a linearly increasing intensity and the other has a linearly 
decreasing intensity. Claims 21 and 23 now depend from the newly added claims 33 and 34. 

With the above changes, it is believed that all the pending claims are not anticipated (or 
suggested by Ogawa or Stein. 
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CONCLUSION 

In view of the above, reconsideration arid allowance of this application are now believed 
to be in order, and such actions are hereby solicited. If any points remain in issue which the 
Examiner feels may be best resolved through a personal or telephone interview, the Examiner is 
kindly requested to contact the undersigned at the telephone number listed below. 

The USPTO is directed and authorized to charge all required fees, except for the Issue 
Fee and the Publication Fee, to Deposit Account No. 19-4880. Please also credit any 
overpayments to said Deposit Account. 



Respectfully submitted, 




SUGHRUE MION, PLLC 
Telephone: (202) 293-7060 
Facsimile: (202) 293-7860 



Chid S. Iyer 
Registration No. 43,355 



WASHINGTON OFFICE 



23373 



CUSTOMER NUMBER 



Date: March 12, 2004 
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METHOD AND DEVICE FOR DETECTING THREE-DIMENSIONAL 

INFORMATION 

DETAILED DESCRIPTION OF THE INVENTI ON 
Field of the Invention 

The present invention relates to a method and apparatus for detecting 
three-dimensional information pertaining to an object which can be applied to 
acquisition of a three-dimensional image, and more particularly, to a method and 
device which detects three-dimensional information pertaining to an object by 
two-dimensionally measuring the distance between points of the object at a speed 
at which the three-dimensional information can be followed in real time within a 
period relating to a frame of a video signal (hereinafter referred to simply as a 
"frame period"). 

Prior Art 

The following methods have conventionally been employed as techniques 
for measuring the distance between an object and an image acquisition device or 
three-dimensional information through use of light. 

(1) As shown in FIG. 12, a pulse laser beam or a laser beam whose 
amplitude is modulated by a sinusoidal wave is radiated onto an object, and the 
distance between the object and the laser is measured on the basis of a period of 
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time during which reflected light returns to the laser or a modulated phase of the 
reflected light. 

[04] (2) As shown in FIG. 13, under the method (1), the distance between the 

respective points of an object is two-dimensionally measured by two- 
dimensionally scanning the laser beam over the object. 

[05] (3) As shown in FIG. 14, illumination light is modulated by a sinusoidal 

signal, and a light amplification gain of an image intensifier disposed in front of 
an image pick-up element is modulated through use of the sinusoidal signal. An 
optical image formed by collecting light reflected from the object through use of a 
lens includes a modulated phase corresponding to the distance between the object 
and the lens. Of an optical image input to the image intensifier, only a portion of 
the image whose phase matches a change in the light amplification gain is 
x emphasized. As a result, the points of the object equidistantly spaced away from 
the lens can be two-dimensionally captured in the form of contour lines. The 
principle behind the third method is described in detail in Japanese Patent 
Application Laid-Open No. Hei-6-294868 entitled "Imaging Laser Radar 
Device." 

Problem to be Solved by the Invention 

[06] | According to the method described in connection with (1), the distance 

between a single point of the object and the laser is measured, and hence three- 
dimensional information pertaining to the object cannot be produced. In order to 
acquire three-dimensional information by measuring two-dimensional 
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distribution of the distance among the respective points of the object, the 



light beam must be moved so as to two-dimensionally scan the object as 
mentioned in the method (2). Alternatively, according to method (3), since only 
portions of the object equidistantly spaced away from the lens are extracted, the 
modulated phase of illumination light must be changed to only a required extent 
in order to acquire three-dimensional information pertaining to the entirety of the 
object. Methods (2) and (3) require two-dimensional raster- scanning of an 
illumination light beam and a change in the modulated phase of the illumination 
light. Therefore, under these methods, acquiring three-dimensional information 
pertaining to the object at a speed equal to the frame period of a video signal is 
difficult. Therefore, the methods are not suitable for acquiring a three- 
dimensional image. 

[07] The object of the present invention is to provide a method and device 

which solve the problem of the conventional technique, are suitable for acquiring 
a three-dimensional image, and enable detection of three-dimensional information 
pertaining to an object within a period of time corresponding to the frame of a 
video signal. 



invention comprises steps of: forming an image of an object illuminated by 
illumination of the modulated light having given intensity as an optical image, 
and detecting the distance between individual points of the object on the basis 



M e ans for Solving the Problem 



SUMMARY 



{08} 



A three-dimensional information detecting method of the present 
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[081 of an image obtained by acquisition of the optical image with a given 

image pick-up gain. Under this method, either the given intensity or the image 
pick-up gain is changed with time, and the distance between respective points of 
the object can be detected at a speed at which the three-dimensional information 
can be followed real time within a period of time corresponding to the frame of a 
video signal. By utilization of the intensity or image pick-up gain which is 
changed with time, the two-dimensional distribution of intensity of light including 
information pertaining to the distance between the respective points of the object 
is acquired. Accordingly, the distance between respective points of the object can 
be determined on the basis of the intensity level information, whereby three- 
dimensional information pertaining to the object can be detected. 
[09] The image of the object can be acquired a plurality of times within the 

period of time corresponding to one frame of the video signal. In such a case, a 
signal-to-noise ratio (S/N) is improved by means of the storage effect of the 
image pick-up element, and the image pick-up intensity is enhanced. 

{10] A device for detecting three-dimensional information of the present 

invention comprises a projection section capable of projecting illumination light 
having given intensity on an object; an image pick-up section capable of acquiring 
an image of the object with a given image pick-up gain; and a signal processing 
section which calculates the distance between respective points of the object on 
the basis of intensity level information included in a video signal output from the 
image pick-up section. Either the given intensity or the image 
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j>ick-up gain is changed with time, and the distance between respective 



FIG. 



points of the object can be detected at a speed at which the three-dimensional 
information can be followed real time within a period of time corresponding to 
the frame of a video signal. By utilization of the intensity or image pick-up gain 
which is changed with time, the two-dimensional distribution of intensity of the 
image of the object that is acquired by the image pick-up section includes 
information pertaining to the distance between the respective points of the object. 
Accordingly, the signal processing section can calculate the distance between 
respective points of the object on the basis of the intensity level information. The 
device can acquire an image of the object within a sufficiently short period of 
time. So long as the signal processing section can compute the distance between 
respective points of the object at sufficient speed, the distance between respective 
points of the object can be detected at a speed at which the three-dimensional 
information can be followed within a period of time corresponding to the frame of 
a video signal. 

Embodiments of BRIEF DESCRIPTION OF THE DRAWINGS 

is a schematic diagram showing the Inv e ntion 



[11] Various — e mbodiments of th e pr e s e nt inv e ntion will b e d e scrib e d 
hor e inb e low by r e f e renc e to th e accompanying drawings. FIG. 1 is a schematic 
diagram showing configuration of a three-dimensional information detecting 
device according to a first embodiment of the present invention; 
[12] FIG. 2 is an illustration for describing a method of detecting three- 

dimensional information by utilization of illumination light which linearly 
increases and has given intensity and a pulse-like image pick-up gain in 
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combination, wherein FIG. 2A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g," and FIG. 2B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[13] FIG. 3 is an illustration for describing a method of detecting three- 

dimensional information by utilization of illumination light which linearly 
decreases and has given intensity and a pulse-like image pick-up gain in 
combination, wherein FIG, 3 A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g," and FIG. 3B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[14] FIG. 4 is an illustration for describing a method of detecting three- 

dimensional information by utilization of illumination light which linearly 
increases and decreases and has given intensity and a pulse-like image pick-up 
gain in combination, wherein FIG. 4A shows a time-varying waveform 
determined by the intensity I of illumination light and an image pick-up gain "g," 
and FIG. 4B shows a time-varying waveform determined by the image pick-up 
gain "g" and the intensity I^of light reflected from an object spaced away from a 
projection section by only distance "d"; 

[15] FIG. 5 is an illustration for describing a method of detecting three- 

dimensional information by utilization of a given image pick-up gain which 
linearly increases and illumination light having pulse-like intensity in 
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combination, wherein FIG. 5 A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g," and FIG. 5B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity lR _ of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[16] FIG. 6 is an illustration for describing a method of detecting three- 

dimensional information by utilization of a given image pick-up gain which 
linearly decreases and illumination light having a pulse-like intensity in 
combination, wherein FIG. 6A shows a time- varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g," and FIG. 6B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[17] FIG. 7 is an illustration for describing a method of detecting three- 

dimensional information by utilization of a given image pick-up gain which 
linearly increases and decreases and illumination light having pulse-like intensity 
in combination, wherein FIG. 7A shows a time-varying waveform determined by 
the intensity I of illumination light and an image pick-up gain "g." and FIG. 7B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[18] FIG. 8 is a schematic diagram showing the configuration of a projection 

section equipped with a light-emitting element whose light is directly modulated; 
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FIG. 9 is a schematic diagram showing the configuration of a projection 
section equipped with a light-emitting element whose light is indirectly 
modulated; 

FIG. 10 is an illustration showing the configuration of an image pick-up 
section employing an image intensifier (II) with gating operation; 

FIG. 11 is an illustration showing the configuration of a signal processing 
section; » 

FIG. 12 is an illustration showing a conventional method of measuring the 
distance between an object and a three-dimensional information detecting device 
on the basis of a lag time or modulated phase of a reflected laser beam; 

FIG. 13 is an illustration showing a conventional method of activating a 
laser beam so as to effect two-dimensional scanning; and 

FIG. 14 is an illustration showing the configuration of a conventional 
imaging laser radar apparatus. 
Description of the Reference Numerals 

1 ... signal generation section, 4 ... lens, 5 ... image intensifier with 

gating operation, 6 ... image pick-up element 7 ... signal processing section, 10 
... projection section, 11 ... image pick-up section, 20 ... optical image transfer 
optical system, 21 ... gate, 22 ... image split circuit 30 ... illumination optical 
system, 31 . . . light-emitting element, 32 . . . external modulator 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Various embodiments of the present invention will be described 



hereinbelow by reference to the accompanying drawings. FIG. 1 is a schematic 
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diagram showing a three-dimensional information detecting device according to a 
first embodiment of the present invention. The device comprises a projection 
section 10 capable of illuminating an object with illumination light S6 whose 
amplitude is modulated; an image pick-up section 

11 which receives light S7 reflected from the object while changing an 



image pick-up gain with time and captures an optical image of the object; a signal 
processing section 7 for converting video signals S41 and S42 output from the 
image pick-up section 11 into a three-dimensional information signal S5; and a 
signal generation section 1 which produces an illumination light modulation 
signal SI, an image pick-up modulation signal S2, and a control signal S3. The 
specific configuration of these constituent elements will be described later. 
ft2j[261 The principle behind the three-dimensional information detecting method 



of the present invention which uses the device shown in FIG. 1 will be described 
by reference to a specific example in which the intensity of the light source or an 
image pick-up gain is linearly changed with time. 

The three-dimensional information detecting method according to a first 



embodiment of the present invention will be described by reference to FIGS. 2 
and 3. As shown in FIG. 2 A, the intensity I of illumination light is subjected to 
amplitude modulation, to thereby obtain I=St, where "t" represents time and "S" 
represents the rate of increase in intensity (= 2Io/T). As shown in FIG. 2B, the 
. intensity Ir of light reflected from the object which is spaced by only distance "d" 
away from an exit of the projection section 10 is changed, as specified by S(t- 
2d/v), with a delay equal to a duration of time during which light travels between 
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the projection section and the object (=2d/v, where "v" represents light speed). If 
reflected light having intensity 1+ at certain time t=t 0 is acquired for only a short 
period of time At («T) while an 
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image pick-up gain "g" is taken as g=go (>0), the intensity 1+ of the 



resultant image is expressed by Equation (1). 



h§0 = 



(7 



g 0 S(t 0 -2d/v)...(l) 



{And 2 ) 1 



where a represents the area of the backward scattering cross-section of an object. 
Equation (1) includes information pertaining to the distance between the object 
and the three-dimensional information detecting device. In order to eliminate the 
dependency of term a I {Aid 2 ) 2 , the second image of the object is acquired while 
the intensity I of illumination light is uniformly maintained at I=I r for a short 
period of time At from time T\ At this time, luminous intensity I re fgo is expressed 
by Equation (2). 



cr 



gJr -(2) 



re/So — 



(And 2 ) 2 



The following equation is derived from Equations (1) and (2). 



Ago 



0 



S(t 0 -2d/v) 



...(3) 



From Equation (3), we have 
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Further, let I r =Io; then 



2 



f 



...(5). 



From Equation (4) or (5), we have distance "d.' 



_As mentioned above, the intensity of respective points of an optical image 



formed by collection of the light reflected from the object exposed to amplitude- 
modulated light includes information pertaining to the distance between the three- 
dimensional information detecting device and a corresponding point of the object. 
So long as the object is captured in the manner as mentioned above and Equation 
(4) or (5) is applied to the intensity of each of the pixels of the image, information 
pertaining to the distance between the respective points of the object are two- 
dimensionally obtained, whereby three-dimensional information pertaining to the 
object can be detected. 



2L 



_As shown in FIGS. 3A and 3B, even when the intensity I of the light 



source diminishes, as specified by I=Io-St, the distance "d" can be obtained in the 
same manner as mentioned previously. 



I-go = 



-g 0 {l 0 -S(t 0 -2d/v)} ...(6) 



R = 



{And 2 ) 2 
I_g 0 _I 0 -S'(t 0 -2d/u) 



•(7) 
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d=-o\ /„-- * 



...(8) 



Further, let I r =Io; then 
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rf= lT°"f (1 " i? - ) 



...(9). 



As in the case of the previous example, the optical image formed by collection of 
light reflected from the object. So long as Equation (8) or (9) is applied to each of 
the pixels of the image, information pertaining to the distance between the 
respective points of the object are two-dimensionally obtained, whereby three- 
dimensional information pertaining to the object can be obtained. 

fMtfjoi Referring to FIG. 4, a three-dimensional information detecting method 

according to a second embodiment of the present invention will now be described. 
As shown in FIG. 4, the object is illuminated while the intensity of illumination 
light is modulated by employment of a triangular waveform. An optical image of 
reflected light is acquired twice; in other words, an optical image of reflected light 
whose intensity is 1+ is acquired at time t=to for only a short period of time At («T) 
with an image pick-up gain g=g 0 (>0), and an optical image of reflected light 
whose intensity is L is acquired at time t=to+T/2 for only a short period of time At 
(«T) with the image pick-up gain g=g 0 (>0). From Equations (1) and (6), we have 



R = 



Lg 0 



S(t 0 -2d/u) 



...(10) 



I 0 -S(t 0 -2d/v) 
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Let the wavelength of illumination light modulated by a triangular waveform be 
defined as X=vT; then from S=I 0 /(T/2), we have 



Further, if t 0 is set to a given value, distance "d" can be expressed as a relative 
distance with reference to a reference point d re f. Equation (13) represents a 
relative distance with reference to d re f=0 when to=T/4. 



As in the case of the first embodiment, the optical image is formed by collection 
of light reflected from the object. So long as any one of Equations (1 1), (12), and 
(13) is applied to each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
obtained. 

tl^H^n According to a method which is complementary to the three-dimensional 

information detecting methods described in connection with the first and second 
embodiments, three-dimensional information pertaining to an object can be 
detected by capturing the image of the object with an image pick-up gain, which 
linearly increases or decreases, through use of illumination light modulated in the 
form of a pulse for a short period of time. 




M R } 



...(12). 




4{l + R) 
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_A three-dimensional information detecting method according to a third 



embodiment of the present invention will be described by reference to FIGS. 5 
and 6. As shown in FIG. 5 A, illumination light is modulated such that an image 
pick-up gain "g" is linearly increased (i.e., g=Ut). Further, an object is exposed to 
light which illuminates like a pulse with intensity I=Io for only a short period of 
time At («T). Here, U designates the rate of increase in image pick-up sensitivity 
(=2go/T). The image pick-up gain g+ obtained when the light reflected from the 
object that is spaced only distance "d" from the three-dimensional information 
detecting device has returned to the image pick-up device becomes 
g + =U(t 0 +2d/v). The intensity Irog+ of an image resulting from the reflected light 
being captured is expressed by Equation (14). 

I rog + = 7 T^hU(t 0 +2d/u) ...(14) 
(And ) 

Further, in order to eliminate the dependency of term a l(A7td 2 ) 2 , the object is 
illuminated for a short period of time At from time T' while the image pick-up 
gain "g" is uniformly maintained at g=g r . At this time, luminous intensity Irog r is 
expressed by Equation (15). 



J rO§r = /A ^2x2 7 0gr -05) 

(And ) 



The following equation is derived from Equations (14) and (15). 



R ^ I r0 g + ^ U(t 0 +2d/u) (16) 

^rO§r Sr 
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From Equation (16), we have 



Further, suppose g r =go; the following expression is derived from U=go/(T/2). 

...(18) 



If T } 
d = -o\-t 0+ -R + 



The distance "d" is derived from Equation (17) or (18). As in the case of the first 
and second embodiments, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (17) or (18) is applied 
to the intensity of each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
detected. 

fl»K: i31 As shown in FIG.6A, even when the image pick-up gain "g" decreases 

(g=g 0 -Ut), the distance "d" can be obtained in the same manner as that employed 
previously. 

7 "S- = 77W 7 ofeo -U(t 0 +2d/u)} ...(19) 

(And ) 

R= I I£ g^ = 8o-U(t 0+ 2d/o) (2Q) 

^ ro S r S r 



lf ti g 0 -R.g, 



d = -v\ -t 0 + 

2 { 0 U 



..(21) 
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Further, let g r =go; then 

j= H~'° + i (i ~* } } " ,(22) 

As mentioned previously, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (21) or (22) is applied 
to the intensity of each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
detected. 

f20tf^41 A three-dimensional information detecting method according to a fourth 

embodiment of the present invention will now be described by reference to FIGS. 
7A and 7B. As shown in FIG. 7 A, the image pick-up gain "g" is modulated 
through use of a triangular waveform, and an object is illuminated twice; in other 
words, an optical image is illuminated at time t=to through use of light which 
illuminates in a pulsating manner with intensity I=Io for only a period of time At 
(«T), and an object is illuminated at time t=to+T/2 through use of light which 
illuminates in a pulsating manner with intensity I=Io for only a period of time At 
(«T). From Equations (15) and (19), we have 

I rag- g 0 -U(t Q +2d/v) 
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Suppose the wavelength of the triangular waveform used for modulating the 
image pick-up sensitivity is defined as A.=vT for convenience's sake, the 
following expression is derived from U=go/(T/2). 



1 * 

a = — otr. — 

2 0 4 



f R ^ 
1 + R 



...(25) 



As in the case of the second embodiment, if to is set to a given value, the distance 
"d" can be expressed as a relative distance with reference to the reference point 
d re f. Equation (26) represents the relative distance with reference to d re f=0 when 
t 0 =T/4. 



...(26) 



As mentioned previously, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (24), (25), or (26) is 
applied to each of the pixels of the image, information pertaining to the distance 
between the three-dimensional information detecting device and the respective 
points of the object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be detected. 

{21] A method of increasing the image pick-up sensitivity in each of the 

previous embodiments will now be described. In the previously embodiments, 
acquisition of an image having intensity I+go and an image having intensity 
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Jrefgo for the purpose of determining R+, acquisition of an image having 



intensity Lg. and an image having intensity I re fgo for the purpose of obtaining R_, 
or acquisition of an image having intensity I+g 0 and an image having intensity Lgo 
for the purpose of determining R is performed a plurality of times within the 
period of time corresponding to one frame of an image signal. As a result, the 
signal-to-noise ratio (S/N) is improved by the storage effect of the image pick-up 
element used for acquiring an image, whereby the image pick-up sensitivity is 
improved. 

f23|[j61 The configuration of the three-dimensional information detecting device 

shown in FIG. 1 will now be described in detail by reference to the drawings. 
FIG. 8 shows a projection section 10a which is another embodiment of the 



projection section 10 shown in FIG. 1. The projection section 10a comprises a 
light-emitting element 31 whose light can be directly modulated by an 
illumination modulation signal SI, and an illumination optical system 30 which is 
disposed opposite the light exit surface of the light-emitting element 31, which 
shapes the light emitted from the light-emitting element 31, and which directs the 
light toward the object. For example, a semiconductor laser diode or a 
semiconductor light-emitting diode can be employed as the light-emitting element 
3 1 . When such a light-emitting element is activated directly by the illumination 
light modulation signal SI which is an electric signal, the element can emanate 
light whose intensity is changed at high speed. The thus-produced light is shaped 
by means of an illumination optical system 30 so as 
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to illuminate an object, whereby illumination light S6 is produced. 



Accordingly, illumination light whose intensity is arbitrarily changed at high 
speed, such as increment light, decrement light, or pulse-like light, can be realized 
by means of the illumination light modulation signal SI. As mentioned above, 
the projection section having the configuration shown in FIG. 8 can be used as 
means for controlling the intensity of illumination light under the three- 
dimensional information detecting method of the present invention. 
FIG. 9 shows a projection section 10b which is still another embodiment 



of the projection section 10 shown in FIG. 1. The projection section 10b 
comprises a light-emitting element 33 which outputs given light; an external 
modulator 32 which is disposed opposite the light exit surface of the light- 
emitting element 33 and indirectly modulates the light emanated from the light- 
emitting element 33 in accordance with the illumination light modulation signal 
SI; and an illumination optical system 30 which shapes the light output from the 
external modulator 32 and is directed toward the object. An electro-optical effect 
light modulator or an electro-acoustic effect modulator can be used as the external 
modulator 32. Light whose intensity is modulated arbitrarily and at high speed 
can be produced by indirect modulation of the given light 34 output from the 
light-emitting element 34, through use of the external modulator 32. The thus- 
produced light is shaped by the illumination optical system 30 so as to illuminate 
an object, whereby the illumination light S6 is produced. Like the projection 
section shown in 
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_FIG. 8, the projection section whose configuration is show in FIG. 9 can 



be used as means for controlling the intensity of illumination light under the 
three-dimensional information detecting method of the present invention. 

^51^91 FIG. 10 shows an image pick-up section 11 which is another embodiment 

of the image pick-up section 11 shown in FIG. 1. The image pick-up section 11 
comprises a lens 4 which receives light reflected from an object and produces an 
optical image, an image pick-up element 6 which is disposed behind the lens 4 
and picks up the optical image output from the lens 4, and an image split circuit 
22 which outputs a video signal pertaining to a plurality of screens included in the 
electric signal output from the image pick-up element 6 while the video signal is 
divided into respective screens. Further, an image intensifier with gating 
operation 5 capable of controlling the image pick-up gain in accordance with the 
image pick-up gain modulation signal S2, which is an electric signal, is attached 
to the front surface of the image pick-up element 6 via an optical image transfer 
optical system 20. A fiber plate or lens can be used as the optical image transfer 
optical system 20. Light S7 reflected from an object is formed on a photo-electric 
screen of the image intensifier with gating operation 5 by means of the lens 4. An 
optical image amplified by the image intensifier with gating operation 5 is 
transferred by the optical image transfer optical system 20 and input to the photo- 
electric screen of the image pick-up element 6. 



-The light amplification gain of the image intensifier with gating operation 



5 can be controlled at high speed by means of a voltage to be 
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^applied to a gate 21 of the image intensifier with gating operation 5. In the 



image pick-up section 1 1, the image pick-up gain can be changed at high speed by 
application of the image pick-up gain modulation signal S2 to the gate 21. 
Accordingly, an image pick-up gain which is changed arbitrarily at high speed, 
such as a pulse-like image pick-up gain to be used for releasing a shutter for only 
a short period of time or an increment or decrement image pick-up gain, can be 
achieved. 

f2^t[|n In a case where the image pick-up section 1 1 is used in each of the 

previous embodiments* the image pick-up section 1 1 must acquire an image twice 
for calculating R+, R-, or R and output a video signal pertaining to two screens per 
frame while the signal is split. To this end, in the image pick-up section 11, the 
image pick-up element 6 is activated twice as fast as it is activated in normal 
times, to thereby acquire a video signal pertaining to two images. The video 
signal is output from the image split circuit 22 while being divided into a video 
signal S41 and a video signal S42. Alternatively, so long as there is employed an 
image pick-up element capable of acquiring an image for each pixel and at every 
image pick-up operation while effecting switching between the video signal S41 
and the video signal S42, the video signals 41 and 42 can be output while they are 
split. 



-As mentioned above, the image pick-up section 1 1 whose configuration is 



shown in FIG. 10 can be used as means for controlling the image pick-up gain 
under the three-dimensional information detecting method of the present 
invention. Further, the image pick-up section 1 1 can also be 
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used as means for outputting two video signals resulting from twice- 

acquisition of an image while being split. 

{29] FIG. 1 1 shows a signal processing section 7 which is an embodiment of 

the signal processing section 7 shown in FIG. 1. In this signal processing section 
7, an internal signal is driven at a rate — which is the same as the number of pixels 
of the video signal — and is subjected to pipe-line processing in individual 
circuits. After a synchronous signal has been eliminated from the video signals 
S41 in a synchronous signal separation circuit 41, the video signal S43 is stored in 
an image pick-up level storage circuit 1, and the video signal S44 is stored in an 
image pick-up level storage circuit 2. A signal S45 output from the image pick- 
up level storage circuit 1 and a signal S46 output from the image pick-up level 
storage circuit 2 are input to a computation circuit 44, where R+, R-, or R and the 
distance "d" are computed. A signal S47 output from the computation circuit 44 
is a time-series signal resulting from two-dimensional scanning of the distance 
between the respective sections of the object. Time-axis fluctuations in the signal 
S47 are corrected by a storage circuit 45, and a synchronous signal is added to the 
thus-corrected signal b a synchronous signal addition circuit 46. The signal is 
output as a three-dimensional signal S5 whose video level corresponds to the 
value of information pertaining to the distance "d" between the respective points 
of the object. As mentioned above, the signal processing section 7 whose 
configuration is shown in FIG. 1 1 can be used as a means for computing three- 
dimensional information pertaining to an object in real time under the three- 
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dimensional information detecting method of the present invention. 

Advantageous Result of the Invention 

41 As has been described in detail, the present invention enables two- 
dimensional determination of the distance between individual points of an object 
at a speed at which the three-dimensional information can be followed real time 
within a period of time corresponding to the frame of a video signal, as well as 
detection of three-dimensional information, by utilization of information 
pertaining to the intensity of an image of the object acquired under condition that 
either the intensity of illumination light or an image pick-up gain is changed with 
time. Consequently, the method and apparatus of the present invention can be 
suitably used for acquiring a three-dimensional motion picture of an object. 
B RIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a sch e matic diagram showing th e configuration of a thr ee 



dim e nsional information d e t e cting d e vic e according to a first e mbodim e nt of th e 
pr e sent invention; 

FIG. 2 is an illustration for d e scribing a method of d e t e cting thre e 



dim e nsional information by utilization of illumination light which lin e arly 
incr e ases and has giv e n intensity and a pulse lik e imag e pick up gain in 
combination, wher e in FIG. 2A shows a tim e varying waveform d e t e rmin e d by th e 
intensity I of illumination light and an image pick up gain "g," and FIG. 



23 





2B shows a time varying waveform determined by the image pick up gain "g" 


and the intensity I^_of light reflected from an object spaced away from a 




projection section by only distance "d"; 
FIG. 3 is an illustration for describing a method of detecting three 


m- 


dimensional information by utilization of illumination light which linearly 


decreases and has given intensity and a pulse like image pick up gain in 


combination, wherein FIG. 3 A shows a time varying waveform determined by the 




intensity I of illumination light and an image pick up gain "g," and FIG. 3B 
shows a time varying waveform determined by the image pick up gain "g" and 


the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 
FIG. 4 is an illustration for describing a method of detecting three 


m- 


dimensional information by utilization of illumination light which linearly 


increases and decreases and has given intensity and a pulse like image pick up 




gain in combination, wherein FIG. 4A shows a time varying waveform 
determined by the intensity I of illumination light and an image pick up gain "g," 


and FIG. 4B shows a time varying waveform determined by the image pick up 


gain "g" and the intensity I^of light reflected from an object spaced away from a 


projection beciion-py-<7fliy uiuiuncc u , 
FIG. 5 is an illustration for describing a method of detecting three 


m- 


dimensional information by utilization of a given image pick up gain which 




linearly — increases — and — illumination — light — having — pulse like — intensity — in 


combination, wherein FIG. 5A shows a time varying waveform determined by 
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the intensity 1 of illumination light and an image pick up gain "g," and FIG. 5B 


shows a time varying waveform determined by the image pick up gain "g" and 




tho intensity If^of light reflected from an object spaced away from a projection 
section by only distance "d"; 
FIG. 6 is an illustration for describing a method of detecting three 




dimensional information by utilization of a given image pick up gain which 




linearly decreases and illumination light having a pulse like intensity in 
combination, wherein FIG. 6A shows a time varying waveform determined by the 




intensity I of illumination light and an image pick up gain "g," and FIG. 6B 
shows a time varying waveform determined by the image pick up gain "g" and 


the intensity I^_of light reflected from an object spaced away from a projection 


section by only distance "d"; 
FIG. 7 is an illustration for describing a method of detecting three 


m- 


dimensional information by utilization of a given image pick up gain which 


linearly increases and decreases and illumination light having pulse like intensity 


in combination, wherein FIG. 7A shows a time varying waveform determined by 




the intensity I of illumination light and an image pick up gain "g," and FIG. 7B 


snows a ume varying wuVciuixq ucicrniiiicu. uy uic uiiugp pii/ii up gum g cttitr 


the intensity I^-of light reflected from an object spaced away from a projection 
section by only distance "d"; 
FIG. 8 is a schematic diagram showing the configuration of a projection 


m- 


section equipped with a light emitting element whose light is directly modulated; 
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[39] I FIG. 9 is a sch e matic diagram showing the configuration of a proj e ction 

section e quipp e d with a light e mitting e lem e nt whose light is indirectly 
modulat e d; 

[ 4 0] | FIG. 10 is an illustration showing th e configuration of an image pick up 

s e ction e mploying an imag e int e nsifier (II) with gating operation; 
[ 4 1] | FIG. 1 1 is an illustration showing th e configuration of a signal proc e ssing 



s e ction; 

FIG. 12 is an illustration showing a conv e ntional method of measuring th e 

distanc e betw e en an obj e ct and a thr e e dim e nsional information d e tecting d e vic e 
on th e basis of a lag tim e or modulat e d phas e of a r e flected las e r b e am; 



FIG. 13 is an illustration showing a conv e ntional m e thod of activating a 

las e r b e am so as to e ff e ct two dim e nsional scanning; and 

[ 44 ] | FIG. 1 4 is an illustration showing th e configuration of a conventional 

imaging las e r radar apparatus. 
D e scription of th e R e f e renc e Num e ral s 

1 ... signal gen e ration section, 4 ... l e ns, 5 ... imag e intensifi e r with 

gating op e ration, 6 ... imag e pick up e l e m e nt, 7 ... signal proc e ssing s e ction, 10 
... proj e ction s e ction, 11 ... image pick up s e ction, 20 ... optical image transf e r 
optical syst e m, 21 ... gat e , 22 ... imag e split circuit, 30 ... illumination optical 
system, 31 ... light emitting e l e ment, 32 ... external modulator 
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WHAT IS CLAIMED IS : 

1 . A method of detecting three-dimensional information, comprising 

steps of: 

forming an image of an object illuminated by illumination light having 
given intensity as an optical image; and 

detecting a distance between individual points of the object on the basis 
of an image obtained by acquisition of the optical image with a given image pick- 
up gain, wherein either the given intensity or the image pick-up gain is changed 
with time, and the distance between respective points of the object can be detected 
at a speed at which three-dimensional information can be followed real time 
within a period of time corresponding to the frame of a video signal. 

2. The method of detecting three-dimensional information as defined 
in claim 1, wherein first and second optical images of the object illuminated by 
first and second illumination light, either of which includes time-varying 
intensity, are formed; first and second images are obtained by acquiring the first 
and second optical images with a single image pick-up gain over a given period of 
time; and the distance between respective points of the object can be detected on 
the basis of the first and second images at a speed at which the three-dimensional 
information can be followed real time within a period of time corresponding to 
the frame of a video signal. 
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3. The method of detecting three-dimensional information as defined 
in claim 2, wherein the intensity of the first illumination light is increased or 
decreased with time, and the second illumination light has a given intensity. 

4. The method of detecting three-dimensional information as defined 
in claim 2, wherein the intensity of the first illumination light is increased with 
time, and the second illumination light is decreased with time. 

5. The method of detecting three-dimensional information as defined 
in claim 1, wherein there are formed first and second optical images of the object 
illuminated by first and second illumination light which illuminate with single 
intensity over a predetermined period of time; and the distance between respective 
points of the object is detected from the first and second images which are 
produced by acquisition of the first and second optical images with the first and 
second image pick-up gains, either of which is changed with time, at a speed at 
which the three-dimensional information can be followed real time within a 
period of time corresponding to the frame of a video signal. 

6. The method of detecting three-dimensional information as defined 
in claim 5, wherein the first image pick-up gain is increased or decreased with 
time, and the second image pick-up gain is uniform. 
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7. The method of detecting three-dimensional information as defined 
in claim 5, wherein the first image pick-up gain is increased with time, and the 
second image pick-up gain is decreased with time. 

8. The method of detecting three-dimensional information as defined 
in any one of claims 1 through 7, wherein the image is acquired a plurality of 
times within a period of time corresponding to the frame of a video signal. 

9. A device for detecting three-dimensional information pertaining to 
an object comprising: 

a projection section capable of projecting illumination light having given 
intensity on the object; 

an image pick-up section capable of acquiring an image of the object 
with a given image pick-up gain; and 

a signal processing section which calculates the distance between 
respective points of the object on the basis of intensity level information included 
in a video signal output from the image pick-up section, wherein either the given 
intensity or the image pick-up gain is changed with time, and the distance 
between respective points of the object can be detected at a speed at which the 
three-dimensional information can be followed real time within a period of time 
corresponding to the frame of a video signal. 
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10. The device for detecting three-dimensional information as defined 
in claim 9, wherein the projection section is equipped with a light-emitting 
element whose light can be modulated in accordance with an electric signal. 

1 1 . The device for detecting three-dimensional information as defined 
in claim 9, wherein the projection section comprises a light-emitting element, and 
a modulator capable of modulating light emitted from the light-emitting element. 

12. The device for detecting three-dimensional information as defined 
in claim 9, wherein the image pick-up section comprises: 

imaging means for producing an optical image upon receipt of light 
reflected from the object; 

an image pick-up element which captures the optical image and outputs a 
video signal; and 

an image intensifier with gating operation which is disposed between the 
imaging means and the image pick-up element and which can control an image 
pick-up gain. 

13. The device for detecting three-dimensional information as defined 
in claim 9, wherein the signal processing section calculates the distance between 
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respective points of the object according to the method defined in any one of 
claims 2 through 8. 
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ABSTRACT OF THE DISCLOSURE 

It is an obj e ct of th e pr e sent inv e ntion to provide a m e thod and apparatus 
which can be appli e d for acquiring a thr e e dim e nsional imag e of an obj e ct and 
d e tect thr e e dim e nsional information pertaining to th e obj e ct r e al tim e within a 
p e riod of tim e corr e sponding to th e frame of a video signal. 

[M e ans for Achieving th e Obj e ct] An image of an object illuminated by 
illumination light having given intensity is formed as an optical image. The 
distance between respective points of the object is determined on the basis of a 
video which is obtained by acquiring the optical image with a given image pick- 
up gain. Here, either the intensity of the illumination light or the image pick-up 
gain is changed with time. The distribution of intensity of the image acquired by 
utilization of such intensity or image pick-up gain reflects a time lag between the 
time at which the illumination light is emitted from a light source and the time at 
which the light reflected from individual points of the object reaches an image 
pick-up device. The distribution of intensity includes information pertaining to 
the distance between the light source and the respective points of the object. -The 
pr e s e nt inv e ntion e nabl e s d e tection of thr ee dim e nsional information at a sp ee d at 
which th e thr ee dim e nsional information can b e follow e d r e al tim e within a 
p e riod of tim e corr e sponding to the fram e of th e vid e o signal. 
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[Charact e ristic Drawing] FIG. 1 
[DOCUMENT NAME] DRAWINGS 



[FIG. 1 ] 
OBJECT 
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51 ILLUMINATION LIGHT MODULATION SIGNAL 
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[FIG. 8] 

LIGHT EMITTING ELEMENT 
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S 1 ILLUMINATION LIGHT MODULATION SIGNAL 

S6 ILLUMINATION LIGHT 

10A PROJECTION SECTION 

30 ILLUMINATION OPTICAL SYSTEM 



[FIG. 9] 

10B PROJECTION SECTION 
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[FIG. 10] 
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20 OPTICAL IMAGE TRANSFER OPTICAL SYSTEM 

21 GATE 

22 IMAGE SPLIT CIRCUIT 

52 IMAGE PICK UP GAIN MODULATION SIGNAL 
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541 VIDEO SIGNAL 

542 VIDEO SIGNAL 



[FIG. 11] 
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4 1 SYNCHRONOUS SEPARATION CIRCUIT 

4 2 IMAGE PICK UP LEVEL STORAGE CIRCUIT 1 

43 IMAGE PICK UP LEVEL STORAGE CIRCUIT 2 

44 COMPUTATION CIRCUIT 

4 5 STORAGE CIRCUIT 
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S41 AND S42 VIDEO SIGNAL 

S47 SYNCHRONOUS PHASE CONTROL CIRCUIT 

[FIG. 12] 
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[FIG. 13] 
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START 
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[FIG. 1 4 ] 
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[DESCRIPTION OF THE REFERENCE NUMERALS] 
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4 2 PHASE CONTROL CIRCUIT 

13 AMPLIFIER 
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